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SECTION  1 

NICS  .  NUCLEAR  INFRARED  CLUTTER  SIMULATOR 


1*1  NICS  SYSTEM  OVERVIEW. 

the  sensor  design  and  develoDmeittc  •  testbed  that  provides 

inte^ptor  optical  sensor  svsL  '  »f  evaluating  surveiUance  and 

env  Jnrent  (lhri^rMSl”“:  "  “  "  ““  “ 

extended  movL  tarn*  btt  !  ^  env.K,„nrents  that  include  point  source  and 

NICS  will  he  can  H  f  ■  ‘°“™8  ratUation.  By  April  1995  the 

(Old,  1994),  making  inim^urinTc*^”''' ‘“**0- 

ate  NICS  has  successhdly  supported  a  wit^^trirraTe  an^ 

COSTS),  and  Brilliant  Eyes.  Surveillance  and  Tracking  Sensor 

The  NICS  can  provide  space  level,  natural,  and  nuclear  t>inl7„h„.  ,  a 

that  can  be  held  at  liquid  nitiogen  or  lowe“,^^^7fo<^‘Xt  tet 

the  vacuum  chamber  so  that  an  FPA  or  sub-module  can  be  muniinated  by  thetofrald”®)  taa^ 
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Figure  1-1.  The  DNA  NICS  configured  for  a  sensor  simulation. 

1.2.  NICS  SYSTEM  CAPABILITIES. 

There  are  two  optical  projectors  that  comprise  the  NICS  system,  the  Static  Display  Optical  Bench 
and  the  Dynamic  Display  Opdcal  Bench. 

1.2.1  NICS  Static  Display  Optical  Bench. 

The  static  bench  optics  consist  of  display  collimation  optics,  a  scanning  mirror  in  collimated  space 
and  reimaging  (sensor)  optics  that  image  the  displays  onto  the  sensor  focal  plane  array  under  test.  ’ 
The  collimator  and  reimager  are  off-axis,  reflective,  three  mirror  designs  that  allow  high  contrast, 
achromatic  imaging.  Both  the  collimator  and  reimager  were  designed  and  fabricated  using 
principles  utilized  for  various  flight  qualified  sensors  and  optical  instruments. 

These  systems  are  nearly  diffraction  limited  from  2  pm  to  beyond  15  pm.  The  beam  combiners 
define  the  optical  spectmm  available  for  testing  as  2  to  15  pm.  The  collimator  and  reimager 
combine  to  give  a  system  magnification  of  0.2,  or  5: 1  imaging  from  the  displays  to  the  FPA.  An 
optical  background  of  lOlO  photons/cm2sec,  X  =  lftfO.5  pm,  can  be  achieved  with  appropriate 
cold  filtenng.  Other  optical  system  specifications  are  given  in  Table  1-1.  Both  the  collimator  and 
reimager  are  located  in  light-shielded  boxes  with  the  system  stop  aperture  located  in  a  tube 
connecting  the  boxes.  The  design  reduces  the  risk  of  off  axis  sources  interfering  with  low 
background,  space  environment  LWIR  testing. 
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Table  1-1.  NICS  optical  system  parameteis. 


Optical  Parameter 

Values 

Imager  F/# 

4.0 

Imager  FOV 

>  l.l°x  1  P 

^  Collimator  F/# 

20.0 

Collimator  FOV 

>  1.1°  X  2.2° 

Blur  Diameter  at  10  um 

100  Um 

Blur  Diameter  at  5  um 

50  Um 

alages  that  can  ‘“■sMon 

cassette  of  three  nuclear  or  natural  clutter  bacJffnr,  h  ^™ator.  One  display  holds  a 

three  target  and  test  reticle  plates  in  a  cassette 

The  display  plates  have  scene  or  target  features  r  ''  ^^^ntinated  by  its  own  blackbody. 

photolithography  generated  masks  The  onto  them  from  electron  beam 

O.lpni,theelectrolbeami“^^^^^^^ 

nut.  JNics  static  display  attributes  are  given  in  Table  1-2. 

- - i-2.  NICS  display  attributes. _ 

- — tsplay  Parameter _  Value 

flutter  Scene  Radiance.  8-12  um  ITT 

I  -  - - - -  _10  to  10~3  W/cm^/Sr 


Target  Irradiance, 
_ 8-12  pm 

Source  Nonuniformity  at  FPA 

- Scene  Plate  Translation 

- Target  Plate  Translation 

Translation  Resolution 

^  Display  Angular  Velocity 

_  Display  Plate 


2x10-11  to  10-6  w/cm2  on 
_ FPA _ 

_  <  1-4%  Across  Field 

_ ±2.2° _ 

_  ±  2.2°  in  X,  ±  2.2°  V 

_  30  Pm  in  display  plane 

_  0  -  7.2  mrad/sec 

6.4  X  6.4  cm 
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t  display  blackbodies  are  BarteU  cones  with  programmable  temperature  control  from  the  opUcal 

tach  eo-ogenic  temperature  to  800K.  The  blackbody  tempetatnre  sensor  calibmtion  is  traceable  to 

e  National  Insomie  of  Standards  and  Technology  (NIST)  platinum  resistor  thermometer  standard 

and  IS  absolutely  accurate  to  ±  2K.  Each  display  has  a  dedicated  filter  wheel  with  eight  filter 
positions. 

Both  the  clutter  and  target  displays  are  mounted  on  translation  stages  to  provide  scene  and  target 
trans  ation,  display  plate  selection,  and  focusing  along  the  optic  axis.  The  scan  miiror  scans 
colhmaw  fight  from  the  displays  along  the  x  (in  scan)  direction.  The  targets  can  he  translated  in  x. 
y  (cross  scan),  and  z  (focus),  while  the  scene  can  be  translated  in  y  and  z.  Both  stages  can  be 
programmed  to  move  on  external  trigger.  In  past  tests,  the  target  stage  has  been  programmed  to 
Simulate  targets  flying  in  parabolic  and  other  trajectories. 

1.2.2  NICS  Dynamic  Display  Optical  Bench. 


me  newest  optical  system,  available  in  the  spring  of  1995,  incoiporates  two  independent  DNA 
Nuclear  Opucal  Dynamic  Display  System  (NODDS)  anays  for  Ailly  dynamic  scene  and  target 
generation  (CDR,  1994).  This  optical  bench  is  shown  mounted  in  the  NICS  in  Figure  1-2  The 

elements.  The  128  displays  are  cuirentlyavaUable  for  use  in  sensor  simulations.  The312am.vs 

are  expected  to  be  available  for  NICS  simulations  in  the  fall  of  1995.  The  displays  provide 
teoadtad  ml^  imagery  at  up  to  200  Hz  with  peak  spectral  radiances  of  10-2  W/cm2  sr  pm. 

MonnTf  .  taating  of  sensor  algorithms.  With 

,  "  "“'-'"-•lia-Ioop  and  transitions  from  point  to  extended  targets  ate  possible  during  a 

Single  simulation  run.  ^ 


me  dynamic  bench  optics  consist  of  display  coUimation  and  reimaging  optics  that  image  the 

isplays  onto  the  sensor  focal  plane  airay  under  test.  The  dynamic  display  bench  collimator  and 

rcimager  are  off-ax.s,  reflective,  three  minor  designs  utilizing  the  same  design  and  fabrication 
pnnciples  of  the  static  bench  optics. 

me  dynamic  display  bench  optics  have  a  diffraaion  limited  design  from  2  pm  to  beyond  15  pm 
me  be^  combiners  wiU  define  the  optical  spectmm  available  for  testing  from  the  short  to  long  ' 

in  ar^spectnims.  The  dynamic  display  bench  collimator  and  reimager  combine  to  give  a  system 

magmfication  of  0.5,  or  2:1  imaging  from  the  displays  to  the  FPA.  Optical  backgrounds  of  lOW 
P  otons/em  see,  X  =  1010.5  pm.  will  be  achieved  in  this  system  with  appropriate  cold  filtering 
Other  dynamic  display  optical  system  specifications  are  given  in  Table  1-3 
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Table  ^3.  NICS  Dynamic  Display  Optical  Bench  parameters. 
- Parameter  I  Values 


Imager  F/# 

4.0 

Imager  FOV 

>2.2°x  2.2= 

1  ■ 

Collimator  F/# 

8.0 

Collimator  FOV 

'  >  2.2°  X  2.2° 

Blur  Diameter  at  10  urn 

100  |Lim 

Blur  Diameter  at  5  um 

50  Um 

ofview.TbeligbtfroJeb::r™^^^ 

combiners  and  projected  by  the  collimator  F  h  ^  ^  combined  with  beam 

with  an  eight  position  filter  wheel.  The  static^Lnlar  '““™nated  by  its  own  blackbody 

of  the  optics  field  of  view.  ^  ^  to  be  ftiUy  in  or  out 


Figure  1-2.  Side  view  of  the  NICS  with  the 


Dynamic  Display  Optical  Bench  installed. 


1.2.3  NICS  Scene  Generation. 


The  NICS  projected  scenes  are  generated  from  code  calculations  or  existing  scenes  such  as  those 
from  the  Strategic  Scene  Generation  Model  or  high  resolution  photography.  Scene  generation 
support  IS  provided  using  automated  software  to  translate  a  computer  stored  image  to  the 
appropnate  format  for  either  the  static  displays  or  the  NODDS  dynamic  displays.  Thousands  of 
frames  can  be  generated  for  video  scene  projection  using  NODDS.  Nuclear  scenes  are  produced 
with  power  spectral  distributions  (PSD)  that  match  the  DNA  specifications  for  nuclear  clutter. 

1.2.4  NICS  Sensor  Simulations. 

The  NICS  system  has  supported  multiple  above  ground  tests  (AGT)  operated  in  gamma,  flash  x- 
ray,  and  neutron  radiation  testing  environments.  The  system  is  easily  transportable  and  can  be 
configured  and  brought  to  operational  status  by  one  technician  in  one  day.  In  addition  to  operating 
m  the  MRC  Radiation  Test  Laboratory,  the  NICS  has  been  successftiUy  deployed  and  operated  at 
several  government  operated  AGT  facilities  including  White  Sands  MissUe  Range  Gamma 
Radiation  Facility  and  the  Aberdeen  Proving  Grounds  Fast  Burst  Reactor/Flash  X-ray  Test 
Facility.  A  testing  history  past  and  scheduled  NICS  sensor  simulations  is  given  in  Table  1-4. 


Table  1-4.  NICS  sensor  simulation  testing  history. 


NICS  Sptem  IOC 

August  1992 

GSTS  Combined  Effects  Emulation 

September  1992 

DNA  Operate  Through  Gamma  Test  at  White  Sands 

March  1993 

USASSDC  PET  FPA  Testing 

May  -  Julv  1993 

Brilliant  Eyes  Sensor  Emulation 

September  1993 

DNA  Operate  Through  FBRff^XR  Test  at  Aberdeen 
USASSDC  PET  FPA  Testing 

November  1993 

July  -  August  1994 

USASSDC  THAAD  FPA  Testing 

December  1994 

DNA  ANICS  Interceptor  Emulation 

April  1995 

DNA  Sensors  Program  Testing 

July  1995 

DNA  Sensors  Program  at  Aberdeen 

September  1995 

USASSDC  THAAD  Interceptor  HWIL  Testing 

February  1996 

1.3.  NODDS  DYNAMIC  DISPLAY  OVERVIEW. 

The  DNA  NODDS  display  development  is  a  collaborative  effort  between  Mission  Research 
Corporation  and  Honeywell  Inc.  The  NODDS  resistor  airay  is  an  approach  to  obtaining  an  IR 
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^ne  projeaor  capable  of  wide  dynamic  range.  The  emitter  army  has  low  theimal  conductance  to 
ft  snbstram  whtch  delivers  high  radiance  and  re,uires  low  power.  The  anay  achieves  ^7 
lance  wit  g  fill  factor,  high  emissivity,  and  high-temperature  (TOOK)  operation. 


1.4. 


Figure  1-3.  NODDS  128  x  128  array  in  a  68  pin  leadless  chip  carrier. 

NODDS  DISPLAY  CAPABILITIES. 


daughter  ^d  that  fits  in  a  Lake  Shote  MTTT  150  c^tat'  ""  ' 

.«.orjpiac=:-:— 
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conduc^ce  materials,  mos,  notably  Si3N*  which  are  pahemed  into  well-defined  shapes,  leading 
to  a  weU-defined  thermal  conductance  path  to  the  substrate. 

The  low  thennal  conductance  would  normally  lead  to  long  time  constants  if  not  for  the  fact  that  the 

Aermal  mass  ts  approxrmately  lO-*  J/K  for  a  2  mil  pixel.  The  thermal  conductivity,  depending  on 

pcr^e,  IS  typically  m  the  range  of  3x10"’  W-pm*.  Thus,  a  pair  of  30  mm  long  legs  wiM 
have  a  thermal  conductance  of  about  10^  W/K. 

A  2^  pixel  with  30  pm  legs  will  have  an  e-folding  tempemtum  time  constant  in  the  range  of  1 
.  The  radiance,  depending  somewhat  on  wavelength,  reaches  90%  of  the  final  level  within  a  few 

NODDS  array  performance  characteristics  are  shown  in  Table  1-5. 

Table  1-5.  NOPPS  display  performance  characteristics. 


Performance  Characteristic 

Spectral  Range 

Max  Effective  In-band  Radiance 
Emission  Spectrum 
Radiance  Range 

Radiance  Resolution 
I  End-to-end  Radiance  Accurao 
Display  Background  Radiance 

^^*^^tice^Vanatioiiin^^^ugg  Time 
I  Pixel-to-pixel  Uniformit 


Specification 
_3  ^12  um 

10'^  W/cm^  sr 
Across  spectral  range 

0.1% 

1% 


<  10'^  WW/sr 


1% 


- : _ 


,  SECTION  2 

methods  for  optical  sensor  systems  test  and  evaldation 

or  system  under  tes, 

NICS  simulator  is  capable  of  testing  ^  ^  ^  imaging  system.  The 

signal  processing  algorithms  only,  or  Z  wS‘c  ' 
test  a  complete  sensor  such  as  an  intemeptor  missUe’"””  ' 

et2me™l“rr,^  f'""' '''  “'°™* 

processing  and  analysis  andm  •  data  acquisition,  data 

per  testing  dollar  spit,  data  wfflTZ" to  achieve  the  most  value 
should  range  from  nominal  to  stressingZrat™  eonditions.  Test  parameteis 

sensor's  mission  objectivl  IdTn  elded  ® 

place  during  the  campaign  to  insum  validirZlZcZZ^  7“““" 

Detailed  test  data  analysis  should  be  conducted  m 

Signal  processor  characterization  results  F’  ii  k  campaign  to  provide  FPA  and 

data  cataloged  and  stored  for  fiiture  refemni  A  basT*"^*'  ^ 

Figure  2- 1 .  optical  sensor  test  campaign  is  shown  in 


2.1 


test  campaign  configuration  requirements. 


test  objectives  which  flow  down  from  the  sensor's  uhtaaT”  ** ^  ““ 
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Figure  2-1.  How  chan  for  FPA  characeerizaaon  tesang  campaign. 


2  1.1  NICS/NODDS  Test  Hardware  Coaflguration. 


^  enviromnenW  simulator  experimental  parameters  must  be  derived  tom  the  test  campaign 
tas  whtch  Should  tow  down  tom  the  sensor  mission  opemhonal  m,utoments.  sL  the 
NICS  an  opucal  scene  stmulator,  most  of  its  operadng  pannneters  dhectty  influence  the  ophcal 
«^al  me, dent  on  the  FPA  under  test.  The  NICS  blackbody  and  its  ophcal  density  filters  in  the 
filter  Wheel  prov.de  flood  iUuminaflon  onto  the  FPA  in  order  to  characterize  attrihls  sucras 

3bad”'T'  »“■?«  "Oise  as  a  funcrion  of  incidence 

-dbad  p„el  mappmg.  Hood  radiance  and  spe«mm  is  contolied  by  adjusfing  blackbody 
temperature.  Radiance  levels  are  controlled  by  opflcal  density  filters  in  the  filter  wheel.  Spectmm 


10 


V°'\T  ““  *^A  Ks.  dewar  filter  cup 

Retail  b^kground  levels  are  determitKd  by  the  spectral  and  optical  density  cold  filter  as  well  as 
the  operating  temperature  of  the  NICS  optics. 

ThT  ^  or  the  NODDS  dynamic  displays. 

It  is  -ll^  ^  designed  and  installed  in  the  NICS  prior  to  operation 

Che  mtrwht  fil«r  “4^!!  1  '’■-kbody  temperature  and 

necesC  rchtn  ^ICS  are 

can  be^n  mt^rtlrrH™'  -- 

s^rn^tli'""  T  “  NICS:  optically  clutBred 

and  deviation"I,Tte  m““ 

crrfi::::y“£F“^^ 

=~=— 

Target  scenarios  vary  from  single  and  multiple  point  sources  for  stanrt  r^ff 

Of  Cs',: 

content  o  th/f  “““  **  “  uddiUon  to  the  acmal 

ntent  of  the  frames  tmaged  onto  the  FPA  and  signal  processor. 

system  prior  to  data  acqlrot“" 
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Figure  2-2.  NICS  and  NODDS  simulator  configuration  options. 
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characterization  has  also  been  documented  (Old.  1994)  Til  nlrMcsT™*  ^ 

Bench  will  chamcterization  wiU  be  completed  by  iL  ^995 

2.1.2  Radiation  Source  Configuration. 

Si"— 

environments  the  fielded  sensor  is  likely  to  eloZlrrampirof'^ 

contain  radiation  include  Van  Allen  belt  earth  o  h  t  r  ^  ^  environments  that 

scnsotn  and  battlefields  containing  detonated  nnc,eL“™rl^lr 

levels  at  the  components  under  test  shieldin  mssion-required  dose  rates  and  total  dose 

subsystems  being  exposed  insures  proper  doses  and  do  ,  Dosimetry  at  the 

operating  environment  ^  ”“^“sary  for  the  simulated  sensor 

Radiation  environments  experimental  configuration  options  are  shown  in  Figure  2-3. 

2.1.3  FPA  and  Electronics  Configuration. 

operation,  and  optimized  to  tlweve  r,!!rplrf!^r  TOe  e““'  "> 

-.-.Besandco.dstops,andc::^~^^ 

FPA  clock  and  bias  drive  electronics  are  configured  according  tn  pp a  ^  ■ 

specifications  for  voltage  and  current  Ip  i  n-  ^  device  manufacturer’s 

a  FPA  readout  test  device  is  available  eten  matching,  and  signal  timing.  If 

avatlable.  electromcs  optimization  should  use  it  instead  of  the 
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Figure  2-3.  Radiation  environment  configuration  options. 

hybridiz^  airay,  because  the  test  device  is  much  less  expensive  than  the  readout  and  detector  anay 
hybnd.  Once  the  drive  electronics  are  optimized  with  the  readout,  the  hybrid  FPA  can  be  installed 

an  Its  electronic  and  radiometric  performance  optimized.  Optimization  frequently  lequiies  iterative 

adjustments  of  clock  timing,  rail  voltages,  and  detector  and  circuit  bias  levels  to  achieve  peak 
optical  and  noise  performance. 
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verify  FPA  operar/  m  crT  “  '° “■"  >“ 

P— ywrie„sy„e,fsri“a::^^^^ 

Major  FPA  and  its  associated  electronics  configuration  steps  are  shown  in  Figure  2-4. 

2.2  SENSOR  PERFORMANCE  CHARACTERIZATION  PROCEDURES. 

2.2.1  Noise  Performance. 

p:s“n:”nri:;;:r  nr  ^  -- 

seuing  of  odrer  -h 

=:r»-r:r“— 

Dark  noise  data  sets  should  be  collected  at  thp  start  r.f  v, .  • 

reconfiguration  in  order  to  veri  A T,  n  !  “‘=‘'  “I*™ent 

noise  cLac  “  ^  ^  have  sinular 

2.2.2  Radiometric  Performance. 

r:rL';rz:r.:’,:::rs;:? 

spatial  unifomiity  dynamic  ranpi*  as  ii  u  ^  lineanty,  responsivity,  detectivity, 

^  as  well  as  other  operatins  charartpristJr^.  d  •  , 

should  be  collected  at  several  hiae.i.K  ^  ^  &  aractenstics.  Radiometric  data  sets 

Wheel.  Signal  levels  should  range  from  the  background  noise  floor  through  hard 
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Figure  2-4.  Focal  plane  array  and  associated  electronics  configuration  options. 
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sa^uon.  As  m  te  noise  data  case,  flood  levels  should  be  collected  at  as  many  levels  with  as 
y  tames  per  level  as  ts  feasible  to  insure  statistically  robust  results. 

s^d  'rcoTrH'^T  flood  data 

sets  should  be  collected  at  the  start  of  each  testing  day  in  order  to  verily  that  FPA  operating 

few  flood  levels  at  one  blackbody  temperature  for  the  daily  verification  sets. 

2.2.3  Ionizing  Radiation  Effects. 

lomring  radiation  effects  can  range  from  negligible  to  severe,  based  on  the  mdiation  dose  rates 

““  'ovel.  Since  performance  ' 

^gradauon  ts  the  prtmao-  effect  radiation  has  on  a  sensor  system,  the  sensor  experiment  should 

luld  be  ^d  rjr""  '  ohara^erization.  Radiation  source  dosimetty 

doseasthe:::“r“"”“'""“^“‘«-“- 

2.2.4  Combined  Optical  and  Radiation  Effects. 

£~“r— 

rinzl  T  r  “  “  <»fl“  'O  beuer 

charactenze  any  effects  that  may  be  observed. 

2.2.5  Optical  Sensor  Simulation  Test  Scenarios. 

sensorcanLtestedf::C’:l~d^^^^^^ 
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^ndiUons.  Typically  i.  is  advanlageous  to  begin  evaluating  sen«>r  performance  against  simple 
«  and  ^eed  to  more  complex  scenarios.  Tire  target  siae,  shape,  emission  specZ 

r^luZer  M  r  “ 

Figine  2-5  shows  a  typical  progression  of  testing  complexity  for  sensor  target  acquisition 

ZrZZTd  Z"  ™  "» 

along  the  FPA  tow  1  ““‘i™ 

pixel  fdl  factor.  The  number  of  targets  and  spacing  between  targets  is  driven  by  mission 

2^  target  data  is  collected,  optical  clutter  can  be  added  as  backgrounds.  Clutter  complexity 
soatial  ®>™cture  (low  spatial  frequency  content)  to  highly  strucmred  (high 

s^ndfiequency  content).  Examples  of  Utese  include  diffuse  sources  su!h  I  an  inZeZ 

signaLT "  "“‘oar  weapons-induced  optical 

‘o-i-g  mdiadon  should  be 

performance  mmission-mquired  engagement  scenarios.  aluate  sensor 

2.2.6  Data  Evaluation  during  Test  Campaign. 

acqursmon  of  good  data  to  meet  sensor  evaluation  criteria.  Pnor  to  the 
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Figure  2-5.  NICS  sensor  testing  options. 
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^ical  parameters  that  should  he  continuaUy  evaluated  during  an  experimental  campaign 

A  radtometncs,  noise  floor  levels,  optical  flux  saturation  level,  data  frame  synchronization  and 
Jitter,  and  subsystem  acquired  total  radiation  dose. 

2.3  POST-TEST  CAMPAIGN  PROCEDURES. 

2.3.1  Detailed  Data  Analysis. 

A  detailed  analysis  of  the  test  data  should  commence  after  the  conclusion  of  the  sensor  test 

campaign.  This  analysis  should  yield  FPA  characterization  mformation  such  as  radiometric 

tesponsmty  and  spatial  response  unifoimity,  mean  detectivity,  D*  dynamic  range,  noise  floor 

evels,  Md  operability.  Sensor  signal  processor  subsystem  parameters  such  as  false  alarm  rate, 

prohabihty  of  detechon,  tracking  accuracy,  aimpoint  selection  accuracy,  and  clutter  mitigation  ’ 

^.form^ce  can  be  determined.  If  radiation  was  an  environmental  component  in  the  testing,  the 

A  and  signal  processor  effects  of  prompt  pulse,  steady  state  flux,  and  total  dose  can  he 
determined. 


2.3.2  Comparison  to  Prior  Test  Results. 

If  test  results  from  a  different  testing  facility  are  availahle  for  the  sensor  under  test,  it  is  frequently 
valuable  to  compare  the  current  results  to  those  obtained  previously.  Prior  test  results  that 
corroborate  the  current  results  are  a  good  indication  that  the  sensor  subsystems  were  operated 
coirect  y  and  that  the  results  obtained  in  each  test  are  most  likely  valid.  If,  however,  the  results  of 
one  test  c^paign  contradict  or  do  not  agree  with  those  of  another  test,  then  questions  arise  as  to 
whether  there  was  a  similar  hardware  configuration  in  the  tests,  whether  the  test  conditions  were 
the  same,  and  whether  there  was  some  component  failure  or  unknown  change  between  the  tests. 

this  event,  thorough  test  documentation  may  provide  the  analyst  with  the  reasons  for  the 
aissimilar  test  results. 

2.3.3  Test  Result  Documentation. 

The  test  campaign  documentation  should  provide  a  complete  summaiy  of  the  test  objectives  the 

procedures  followed  to  meet  those  objectives,  a  comprehensive  listing  of  the  data  acquired  during 

e  campaign,  the  expenmental  configuration  for  each  data  set,  data  analysis  results  and 

conclusions, ^d  recommendations  for  future  testing  of  the  same,  or  simUar,  sensor  focal  planes  or 

electromcs.  Table  2-1  lists  many  of  the  generic  entries  necessary  for  a  comprehensive  experiment 
report. 
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Contents  of  a  experimental  test  report. 

I  Introduction _  I 

I  Experiment  objectives _  I 

I  Test  plan  listing _  I 

I  Hardware  configuration  notes  I 

|_Experiment  layout  diajgram  I 

p>aily  experimental  notp.  ina _ ^ 

ISummary  of  test  file  headeo;  I 

I  Sample  image  files  printed _  | 

I^Radiation  dosimetry  notes  I 

p^adiometric  calihration  notes  I 

Ijjuick-look  data  analysis  results  I 

I  Detailed  data  analysis  results  f 

IComparison  to  previous  rP^nitc  I 


2.3.4  Test  Data  Cataloging  and  Archiving. 


O' 

Expenment  documentation  should  enable  a  r«.re 
data  was  coUected  daring  a  ,es,  campaign.  M 

be  archived  along  with  as  much  infonnalion  on  the  I  ‘““ng  campaign  should 

^--dirioninrotmationr:::: 

documenting  each  data  set  collected.  Table  ZT  fof 

system  configuration  data  that  is  acquired  for  each  dm  Optical  Bench 
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Display  Optical  Bench  system  configuration  data. 
^ta  file  path  name  (DOS)  Beam  combiner  temp  (K)  |  Tank  temp 


TCggered  DAQ  (yAi) - Cold  cover  temp  (K) _ Collimator  box  temp  (K) 


Scene  mask  mount  temp  (K) 


Trigger  offset  (s) 


Background  start  tcrn'i 


Background  stop  rcm'i 


Background  rate  (cm/s)  QB  right  temp  (Ki 


X  start  (cm) - OB  center  temp  (K) _ Target  mask  mount  temn  (K't 


Scene  BB  mount  temp  riC') 
Target  blackbody  temp  (K)  Scene  filter  wheel  temp  (K~) 

Target  filter  wheel  temp  tTC') 


Target  X  stop  (cmi 


OB  left  temp  (K) 


Target  BB  mount  temp  (K) 


_arget  Y  start  (cm) - Chamber  vacuum  (uTorr)  Scanner  mount  temp  (K) 

T^get  Y  stop  (cm) - - — Scene  blackbody  temp  (K)  Imager  box  temp  (K) 

Target  rate  (cm/s) 


should 

be  stored  with  each  data  set  collected  during  an  FPA  testing  campaign. 

_ ™g2-3.  FPA  and  data  acquisition  test  configuration  data. 


Device  manufacturer _ Experiment  Numb 

^vice  nomenclature _ Total  dose  on  devi, 

description  of  test  Gamma  flux  level 

Radiation  facility  /  source  type  Detector  bias  level 


_Experiment  Number  TB  #2  Sample  period 
Jbtal  dose  on  device  TB  #1  Sample  period 


Samples  in  TB2 
Samples  in  TBl 


[Detecornumberrs) - Voltage  amp  .ain  setdn.  Nun,be,  of  oos. 

Blackbody  chopping  frequencv  Blackbody  tempeiamte  Numberofore,rinner,,o,r'.- 


Integration  time 


Preamp  Channel  1 
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TIA  LF  roll-on 


^ble2-3.  FPA  and  data  acquisition  test  configuration  data  (continued). 


TIA  HF  roll-off 
TIA  coupling 


Voltage  amplifier  LF  roll-nn 
Voltage  amplifier  HF  mll.nff 
[Voltage  amplifier  coupling 
Blackbody  aperture  size 


Timing  fiJe  name 
I  Date 
I  Time 


ptics  F/# 
LN2  filter 
LN2  aperture 


j>evice  Temperature 

Active  segment  numhpr 

[j^cquisition  modf» 

Number  of  channels 
recorded 

annel  t 

erator  name. 

Data  directory  path 


Distance  LNZapenure  to  device  Recotder  status 


LHe  filter 
LHe  aperture 
Distance  LHe  aperture  to  device 
Dewar  Background  Incidpnrv^ 


Segment  size 
.Starting  segment  number 
Ending  segment  number 

.DataFonnat^^^tes/mxel 


SvO  during  a  test  campaign  should  be  archived  usi 

SyQuest  or  Bernoulli  cartridge 


Preamp  Channel  9 
Preamp  Channel 
Preamp  Channel  4 
j)ata  Acq.  Trigger  coupling 
Data  Accj.  Trigger 
j)ata  Acq.  Trigger  sloj- 
I  Data  Acq.  Upper  trigger  level 

j>ata  Acq.  Lower  trigger  Ip.vpI 
Ijxtemal  trigger  setur 

Detector  length  (physical 

optical) _ 

Detector  width  (physical 
optical) 


I  Detector  thickness 


disc  (WORM  CD).  The  data  fonnat  on  L  mediLhLid  r  compact 

Since  many  platforms,  including  pers™”  !  ™ T  T  ^  ® 

Standard.  workstations,  have  access  to  the 


usmg  long  lifetime  media  such 


as  a 
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SECTION  3 

TEST  PLAN  FOR  SENSOR  TEST  AND  EVALUATION 


3.1 


SAMPLE  SENSOR  TEST  PLAN. 


stanng  feal  plane  array  m  fte  NICS  at  the  MRC  Radiation  Test  Laboratoty.  The  sensor  FPA  was 
evaluated  at  a  single  integration  time  and  device  bias  with  two  different  timing  patterns  lefemed  to 
as  gan^  oncnmvention  ‘W  and  ‘ W.  The  testing  focused  on  FPA  noise  Id  mdio" 

andradialr^™”""*^^^ 

3.1.1  Flood  Datasets. 


1 .  Set  integration  time  based  on  scene  blackbody  (BB)  floods. 

2 .  Set  blackbody  temperature. 

3 .  Turn  gamma  suppression  off  and  capmre  45  frames. 

4.  Turn  gamma  suppression  on  and  capture  45  frames. 

5.  At  several  temps,  capture  OD’s  for  BB  temperature  check. 

6.  Repeat  3, 4  and  5  at  «  10  BB  temps  (dark  -  660K).  Signal  levels 
signalfliackground  into  hard  FPA  saturation. 


range  from  no  optical 


3.1.2  Gamma  Datasets. 


1 .  Capture  gamma  set  (90  frames)  at  1.5  x  109  yWs  with  gamma  suppression  on, 

2 .  Repeat  for  gamma  suppression  off. 

3 .  Reduce  gamma  flux  to  7.5  x  10^  y/cm^s  and  capture  90  frames. 

3.1.3  Floods  and  Gammas  Datasets. 

1.  Set  flood  level  for  near  saturation  signal  level.  Verify  that  FPA  is  not  satnrated. 
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2. 


Capture  gamma  and  flood  (30  frames) 
with  gamma  suppression  on. 


at  maximum  gamma  flux  rate  (1.5  xl09  Y/cm2s) 


3 .  Capture  30  frames  with  flood  only. 

4.  Capture  30  frames  of  gammas  with  gamma  suppression  off. 

5.  Capture  30  frames  with  flood  only. 

6 .  Repeat  2-5  using  10%  transmission  filter  over  flood. 

7.  Repeat  2-5  using  3.6%  transmission  filter  over  flood. 

8.  Repeat  2-7  with  gamma  flux  rate  of  5xlo8  y/cm2s. 

3.1.4  Targets  and  Gamma  Datasets. 


1.  ««<-getsforsigtt^,eve,.agsing,egammaeveut.  Verify  that  FPA  is  not  saturated. 

with  gamm!  suTm^or  P'’f>:ni2s) 


3 .  Repeat  step  2  for  gamma  suppression  off. 

4.  Repeat  2  and  3  using  50%  transmission  fdter  over  targets  (target ,  single  event, 

5.  Repeat  2  and  3  using  10%  tmnsmission  filter  over  target  (target  -  20%  of  single  event) 
3.1.5  Srittionany  CluHer,  Moving  Targets,  and  Gamma  Daritsets. 

Se.ciutterforsigna,leve,.50%FPAsaturation.  Verify  that  PPA  is  not  samrated. 

2 .  Set  targets  for  signal  level .  20%  single  gamma  event  (10%  filter  from  above). 

3 .  Capture  dataset  (30  frames)  at  maximum  gamma  flux  rate  (1 .5E9  v/ctn2s)  with 

suppression  on.  Document  target  location.  Vcm2s)  with  gamma 

4. Capmredataset(30frames)forgammasuppressionoffatsametarg^ 

5.  Step  target  complex  about  1/2  pixel  along  diagonal  trajectoo-. 

6.  Repeat  3  and  4. 
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7 .  Repeat  steps  5,  3,  and  4  for  10  datasets. 

3.1.6  Moving  Clutter,  Moving  Targets,  and  Gammas  Datasets. 

1 .  Set  clutter  for  signal  level «  50%  FPA  saturation.  Verify  that  FPA  is  not  saturated. 

2 .  Set  targets  for  signal  level «  20%  single  gamma  event. 

3 .  Capture  dataset  (30  frames)  at  maximum  gamma  flux  rate  (1 .5E9  Y/cm2s)  with  gamma 
suppression  on.  Document  target  location. 

4.  Capture  dataset  (30  frames)  for  gamma  suppression  off  at  same  target  location. 

5 .  Step  target  complex  about  1/2  pixel  along  diagonal  trajectory. 

6 .  Move  clutter  x  pixels  in  vertical. 

7.  Repeat  steps  3-6  for  10  datasets. 

3.1.7  FPA  Temporal  Response  Using  NODDS  Array. 

1 .  Image  NODDS  emitter  blinking  at  40  Hz  onto  FPA. 

2.  Capture  100  frames  with  gamma  suppression  on. 

3 .  Repeat  data  capture  for  gamma  suppression  off. 

4.  Repeat  steps  2  and  3  for  NODDS  running  at  20  Hz  and  10  Hz. 

3.1.8  Flash  X-ray  Datasets. 

Note;  Hash  X-ray  (FXR)  voltages  refer  to  single  Marx  bank  voltage.  Total  shot  voltage  is 
12  times  the  stated  voltage. 

1 .  Capture  FXR  set  (90  frames)  with  no  optical  signal  at  90  KV  charge  with  gamma 
suppression  on. 

2 .  Repeat  for  gamma  suppression  off. 

3 .  Repeat  steps  1  and  2  for  80  KV  and  70  KV  charge. 
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3.1.9  Floods  and  FXR  Datasets. 

flood  level  for  near  saturation  signal  level.  Verify  that  FPA  is  not  saturated. 

2 .  cap^re  FXR  a„,  flood  (90  W,  a,  90  KV  charge  with  ga^pa  supp^ssiop  on. 

3 .  Capture  90  frames  with  flood  only. 

4.  Capte90f,amesof90KVchargesho,wia,ga„n„asuppressionoff. 

5 .  Capture  90  frames  with  flood  only. 

6 .  Repeat  2-5  using  10%  transmission  filter  over  flood. 

7.  Repeat  2-5  using  3.6%  transmission  filter  over  flood. 

8.  Repeat  2-7  with  80  KV  charge  on  FXR  banks. 

3.1.1*  SU.I.„ar.  CuHer.  Moving  Targets.  FXR,  and  Ganrma  Datasets. 

I.  S^clntterforsignalievel-SO^fFAsamration.  Verify  that  FPA  is  not  saturated. 

Set  targets  for  signal  level .  20%  single  gamma  event  (10%  filter  from  above). 

3 .  Set  target  stage  for  3  cm  diagonal  trajectoiy  at  1  cm/sec  with 

into  scan.  sync  trigger  1  second 

4.  Capmre  damset  (90  frames)  at  maximum  gamma  flux  mm  (1  5E9  v/cm2s)  wid, 
locadon  a.  start  and  end™  '  “ 


5.  Repeat  step  4  for  gamma  suppression  off  for  same  target  scan. 


6-  Step  target  complex  about  1/2  pixel  along  vertical  trajectoiy. 
7.  Repeat  steps  4  and  5. 
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SECTION  4 

distributed  interactive  simulation  methods 

APPLIED  TO  NICS  TESTING 


4.1  OVERVIEW  OF  NICS  DISTRIBUTED  INTERACTIVE  SIMULATIONS. 

Distributed  Interactive  Simulation  (DIS)  testing  using  the  DNA  NICS  with  NODDS  dynamic 
displays  represents  a  new  means  of  providing  DNA  sensor  test  and  evalnation  capabiUUes  to 
sensor  testing  customers.  The  implementation  of  DIS  methods  to  NICS  sensor  simnlations  offers 
many  advantages  to  testing  customers:  rapid  distribution  of  testing  data  and  resnlts  to  m„liiri» 
sensor  designers,  developers,  and  program  offices;  widespread  availability  of  the  DNA  sensor  test 
»d  evaluation  capabilities;  reduced  costs  for  the  testing  customers  resulting  in  more  efficient, 
gher  quality  sensor  system  demonstration  and  validation;  and  increased  visibility  for  DNA 
programs  and  technology  development  efforts.  By  utilizing  a  distributed  data  communications 

network,  the  test  data  is  made  available  to  multiple  sites  and/or  program  offices,  providing  wider 
area  distribution  of  test  results. 

4.2  ADVANTAGES  OF  NICS  DIS  TESTING. 

Widespread,  high  speed  data  distribution  adds  significant  value  to  the  NICS/NODDS  sensor 

testing  facility.  The  major  attnbutes  of  using  distributed  interactive  networking  include  real-time 

scene  generation  from  remote  sites  and  hardware-in-the-loop  test  capabilities,  data  vaUdation  in  near 

re  time  to  insure  expenment  validity,  and  reduced  testing  costs  for  all  programs  involved  in  the 
Simulation. 

4.2.1  Hardware-in-the-Loop  NICS  Testing. 

High  speed  data  communications  linking  the  NICS  simulator  to  remote  scene  generation  and  data 
processing  facilities  provides  an  integrated,  multi-facility  hardware-in-the-loop  rim.,i.,i„„ 
capability.  Simulauon  scenes  generated  by  remote  computing  facilities  can  be  relayed  over  high 
bandwidth  communications  links  such  as  T1  lines  to  the  NICS  facUity.  There,  the  scenes  will  be 
pr^essed  for  display  on  the  NODDS  and  projected  through  the  NICS  optics  onto  the  sensor  FPA 
under  test.  Data  is  acquired,  formatted  and  encrypted  using  the  proper  protocols  for  the 
conraumcauons  service,  and  sent  out  to  the  remote  processing  facility.  The  signal  processing 
facility  compntes  sensor  manenvers  and  diverts  according  to  the  sceneiy  input,  calculates  new 
sensor  state  vectois,  and  sends  the  state  vectors  to  the  scene  compulation  system.  The  new  scene 
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I '  T  NICS  facmty  for  display.  This  disMbuted 

ystem  makes  use  of  multiple  facilities’  remote  resourees  iu  a  single,  integrated,  hardware-in-the- 

loop  sensor  stmulanon.  A  simple  conceptual  layout  of  a  distributed  NICS  sensor  simulation  is 
snown  in  Figure  4-1. 


Interceptor 

Processing 

Facility 


a. 
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IIRilBIIBIigi 
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Signal  Processors 
IMU  Processors 


Receive  Image  Data 
Access  Target  Coordinates 
Calculate  Interceptor  Diverts 
Send  Interceptor  State  Vector 


□ 


1111111111^3 


Interceptor 
^  Hardware 
3J  Simulator 


Receive  State  Vector 
Calculate  New  FOV  Scene 
Display  Scene  on  NODDS 
Image  Through  NICS 
Image  with  Interceptor  FPA 
Send  Image  Data  to  Processors 


jTest  Program  Office  | 

Simulation  Command/Control 
Monitor  Simulation  Progress 
Remote  Site  Evaluation 


icsources 


Figure  4- 1 .  mstributrf  NICS  sensor  simulation  linking  separate 
bandwidth  communications  network.  ^ 

4.2.2  Data  Validation  During  the  Test  Campaign. 

DK  testing  can  prevent 

need  for  addtUonal  test  campaigns  when  com.pt  or  simply  Insufficient  data  see  are  acquired 
d™.Resm.swill,„icklyindi.^ 

dam.  Thts  prevent  tfte  experiment  from  ending,  hardware  being  disassembled,  and  personnel 
vmg  the  test  site  without  the  required  data.  DIS  prevents  a  premature  experiment  shutdown  and 
consequently  reduces  the  costs  of  experiment  reconflgtuation  and  retesdug.  In  addMo„,“ 
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™aly,.s  pro^ssing  daa  can  help  diagn<«  probtos  during  burial  haniware  conflgurarion  a.  U.e 
beginning  of  a  test  campaign. 

4.2.3  DIS  Reduces  Testing  Costs. 

“lato  tearing  and 

rew  r  ““  tea.  and 

elymg  sensor  software  simolarions,  which  in  many  instances  do  not  faithfUUy  replicate  fte 

sensor  operaring  envnonment.  The  most  significant  cos.  savings  (aside  from  saving  a  mtes.  due  to 

insufficient  data  collection)  are  in  personnel  travel  and  in  hardware  shipment.  Table  4-1  lists 
several  areas  of  cost  savings  using  DIS. 

Estimated  cost  savings  for  a  nominal  two  week  NICS  test  using  DIS. 

JVICS  Testing  Savings  with  DIS  |  Test  Savings 
Disassembly  and  packing  at  MRC  $1K 

System  assembly/checkout  at  remote  facility 
System  disassembly  at  remote  facility 
System  assembly/checkout  at  MRC 
ANICS  personnel  travel 
Customer  analyst  travel 
NICS  shipment  with  commercial  carrier 
Remote  facility  coordination  &  planning 
Remote  site/shipping  contingencies  | 

I  Radiation  source  operation  jjqj^ 

Total  Savings  for  Test  Customer  $40K 


Customer  technical  staff  navel  savings  can  be  significant,  DIS  will  allow 
vanous  connactor  and  program  office  sites  to  analyze  test  data  in  near  real 


multiple  data  analysts  at 
time  without  travel  or 
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wmem  shipment  costs.  Assuming  that  four  analysts  will  study  the  test  data  over  the  course  of  a 

$  2K.  The  total  test  savtngs  is  about  $40K  based  on  these  assumptions.  ^ 

For  a  MCS/NODDS  DIS  FFA  test,  the  most  that  a  customer  would  ship  would  he  their  focal 
,  “  r  T’  ““  ^  The  shipment  of  the*  items  is 

■he  NICS  ^d  tts  support  systems.  The  reduced  risk  to  hardware  resulting  from  less  fmuuent 

moDoTsy^r.”' of  fhe 


4.3 


DIS  METHODS  APPLIED  TO  NICS  SENSOR  TESTING. 


A  NICS  sensor  simulation  utilizing  DIS  would  have  a  Woi  i 

NICS  system  either  at  MRC  a  am  •  ^  ^  ^  mounted  in  the 

facility.  NODDS  dv  •  ’  •  ^  emment  testing  facility,  or  at  a  program  office  subcontractor’s 

a^the  testing  ^-111™^^^^^  -sor 

“fi22or““ 

h— ca.erforse„sors-~^^^^^ 


4.4 


data  communication  and  NETWORKING  ISSUES. 


compression  over  analog  phone  lines  can  achieve  about  40 1^"Z!Z  "Z 

CslZc:!  T 

compression,  can  achieve  over  100  kb/s  transfer  rates  WiaWc  ^  ^ 

Tl,  and  T3  offer  much  higher  bandwidth  but  at  significanUy  hig^or^Z 
be  considemd  in  the  context  of  testing  m^uhements  and  avlbl  testtri g  b“ 
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'>“<'™dehs,  a„d  rough-order-of- 

““  ""  “f  ™es  U  likely  ,o  decrease  signifieanrly  i 


in 


Table  4- 


Candidate  data  communication  serwces  for  PIS  NICS  sensor  testing. 


Service 

Service 

Bandwidth 

Transmission 

Bandwidth 

Installation 

Cost 

Service 

Cost” 

Hardware 

Standard 

Telephone 

56  kb/s 
analog 

115  kb/s  with 
compression 

$100 

$25/month  + 
connect  time 

Required 

$600  for  2 

ISDN 

56  kb/s 
digital 

115  kb/s  with 
compression 

$50 

$42/month  + 
connect  time 

iiiuucins 

$5000  for  2 
routers, 

pHaritAr 

1  Switched  56 

1 56  kb/s 
digital 

115  kb/s  with 
compression 

^  $50 

[$42/month  + 
connect  timp 

aviapLCX 

1  $3000  for  2 

T1 

1.544  Mb/s 

digital 

>  3  Mb/s  with 

viXlXt^ 

$13K/month 

louiers 

DSU/CSU, 

routers 

Switched 

T1 

1.544  Mb/s 
digital  on 
demand;  dial 
up  service 

>  3  Mb/s  with 
compression 

$0 

$ 1500/month 
plus  $400/ 
hour  usage 

DSU/CSU, 

routers 

r.r.r=;“rrrrr"“ 


4.5 


mrc  radution  laboratory  in  dis  nics  testing. 


““:“ert 

support  customer  testing  in  this  facility  Conti  ’  is  required  to 

ng  this  facility.  Continuous  gamma  environments  are  provided  by  the 
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.  ■  “>  8»™>a  source,  the  MRC  Pulserad  1 12A  Rrehn'„,„i.i„-r 

thf^  fc  I  .  ^  ^  provide  dose  rates  of  5  x  lOlO  y/cm^sec  at 

c^al  n  ‘°  0”  'he  OKter  of  1  X  109  y/ 

instead  of  a,  ‘“'7  '^'ure“=”'^  ure  at  or  below  these  dose  rates,  then  testing  at  MRC 

sCngcCr 
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SECTION  5 
CONCLUSION 


Tbs  test  methods  interim  report  documents  methods  developed  for  the  test  and  evaluation  of 
m  eieepto  and  surveillance  sensor  systems  using  the  Defense  Nuclear  Agency  (DNA)  Nuclear 

x^nence  gamed  over  the  course  of  several  NICS  sensor  focal  plane  array  (FPA)  test  camnaiv 
and  the  suhse^uent  data  analysis  ne^ssaiy  to  evaluate  FPA  and  modeled  selsorirf^r 
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